MeshFlow: Minimum Latency Online Video Stabilization

نویسندگان

  • Shuaicheng Liu
  • Ping Tan
  • Lu Yuan
  • Jian Sun
  • Bing Zeng
چکیده

Many existing video stabilization methods often stabilize videos off-line, i.e. as a postprocessing tool of pre-recorded videos. Some methods can stabilize videos online, but either require additional hardware sensors (e.g., gyroscope) or adopt a single parametric motion model (e.g., affine, homography) which is problematic to represent spatiallyvariant motions. In this paper, we propose a technique for online video stabilization with only one frame latency using a novel MeshFlow motion model. The MeshFlow is a spatial smooth sparse motion field with motion vectors only at the mesh vertexes. In particular, the motion vectors on the matched feature points are transferred to their corresponding nearby mesh vertexes. The MeshFlow is produced by assigning each vertex an unique motion vector via two median filters. The path smoothing is conducted on the vertex profiles, which are motion vectors collected at the same vertex location in the MeshFlow over time. The profiles are smoothed adaptively by a novel smoothing technique, namely the Predicted Adaptive Path Smoothing (PAPS), which only uses motions from the past. In this way, the proposed method not only handles spatiallyvariant motions but also works online in real time, offering potential for a variety of intelligent applications (e.g., security systems, robotics, UAVs). The quantitative and qualitative evaluations show that our method can produce comparable results with the state-of-the-art off-line methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

MeshFlow: interactive visualization of mesh construction sequences

The construction of polygonal meshes remains a complex task in Computer Graphics, taking tens of thousands of individual operations over several hours of modeling time. The complexity of modeling in terms of number of operations and time makes it difficult for artists to understand all details of how meshes are constructed. We present MeshFlow, an interactive system for visualizing mesh constru...

متن کامل

Deep Online Video Stabilization

Video stabilization technique is essential for most handheld captured videos due to high-frequency shakes. Several 2D-, 2.5Dand 3D-based stabilization techniques are well studied, but to our knowledge, no solutions based on deep neural networks had been proposed. The reason for this is mostly the shortage of training data, as well as the challenge of modeling the problem using neural networks. ...

متن کامل

A Study of Algorithms for Minimum Latency Problem and Online Job Scheduling

We study two problems namely the Minimum Latency Problem (aka the travelling repairman problem) and the Machine Minimization Problem in online job scheduling. The Minimum latency problem is known to be NP-hard even when restricted to weighted trees. The problem has been shown to have PTAS for weighted trees and graphs with a Eucledian metric. We also investigate the problem for caterpillar grap...

متن کامل

Design and Implementation of Optimistic Constructs for Latency Masking in Online Video Games

To achieve interactive experiences comparable to offline games, online video games played over the Internet must be able to deal with performance issues caused by the connection or infrastructure of the underlying network. A particularly difficult issue faced by developers of online games is that of latency. In many cases, the latency encountered forces gameplay to be very frustrating and break...

متن کامل

A Control Method of Dynamic Selfish Routing Based on a State-Dependent Tax

A selfish routing game is a simple model of selfish behaviors in networks. It is called that Braess’s paradox occurs in the selfish routing game if an equilibrium flow achieved by players’ selfish behaviors is not the optimal minimum latency flow. In order to make the minimum latency flow a Nash equilibrium, a marginal cost tax has been proposed. Braess graphs have also been proposed to discuss...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016